Finding Density Functionals with Machine Learning 
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Machine learning is used to approximate density functionals. For the model problem of the kinetic 
energy of non-interacting fermions in Id, mean absolute errors below 1 kcal/mol on test densities 
similar to the training set are reached with fewer than 100 training densities. A predictor identifies 
if a test density is within the interpolation region. Via principal component analysis, a projected 
functional derivative finds highly accurate self-consistent densities. Challenges for application of our 
method to real electronic structure problems are discussed. 
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Each year, more than 10,000 papers report solutions 
to electronic structure problems using Kohn-Sham (KS) 
density functional theory (DFT) P, [ij . All approximate 
the exchange-correlation (XC) energy as a functional of 
the electronic spin densities. The quality of the results 
depends crucially on these density functional approxima- 
tions. For example, present approximations often fail for 
strongly correlated systems, rendering the methodology 
useless for some of the most interesting problems. 

Thus, there is a never-ending search for improved XC 
approximations. The original local density approxima- 
tion (LDA) of Kohn and Sham Q is uniquely defined by 
the properties of the uniform gas, and has been argued 
to be a universal limit of all systems Q . But the refine- 
ments that have proven useful in chemistry Q and mate- 
rials Q are not, and differ both in their derivations and 
details. Traditionally, physicists favor a non-empirical 
approach, deriving approximations from quantum me- 
chanics and avoiding fitting to specific finite systems Q . 
Such non-empirical functionals can be considered con- 
trolled extrapolations that work well across a broad range 
of systems and properties, bridging the divide between 
molecules and solids. Chemists typically use a few 0, Q 
or several dozen parameters to improve accuracy on a 
limited class of molecules. Empirical functionals are lim- 
ited interpolations that are more accurate for the molec- 
ular systems they are fitted to, but often fail for solids. 
Passionate debates are fueled by this cultural divide. 

Machine learning (ML) is a powerful tool for finding 
patterns in high-dimensional data. ML employs algo- 
rithms by which the computer learns from empirical data 
via induction, and has been very successful in many ap- 
plications 10Ml2|. In ML, intuition is used to choose 
the basic mechanism and representation of the data, but 
not directly applied to the details of the model. Mean 
errors can be systematically decreased with increasing 
number of inputs. In contrast, human-designed empiri- 
cal approximations employ standard forms derived from 
general principles, fitting the parameters to training sets. 
These explore only an infinitesimal fraction of all possible 



functionals and use relatively few data points. 

DFT works for electronic structure because the under- 
lying many-body Hamiltonian is simple, while accurate 
solution of the Schrodinger equation is very demanding. 
All electrons Coulomb repel one-another, have spin 1/2, 
and are Coulomb attracted to the nuclei. ML is a natural 
tool for taking maximum advantage of this simplicity. 

Here, we adapt ML to a prototype density functional 
problem: non-interacting spinlcss fermions confined to 
a Id box. subject to a smooth potential. Wc define key 
technical concepts needed to apply ML to DFT problems. 
The accuracy we achieve in approximating the kinetic en- 
ergy (KE) of this system is far beyond the capabilities of 
any present approximations and is even sufficient to pro- 
duce highly accurate self-consistent densities. Our ML 
approximation (MLA) achieves chemical accuracy using 
many more inputs, but requires far less insight into the 
underlying physics. 
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FIG. 1. (color online). Comparison of a projected (see within) 
functional derivative of our MLA with the exact curve. 

We illustrate the accuracy of our MLA with Fig. [U in 
which the functional was constructed from 100 densities 
on a dense grid. This success opens up a new approach to 
functional approximation, entirely distinct from previous 
approaches: Our MLA contains ^ 10^ empirical numbers 
and satisfies none of the standard exact conditions. 
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The prototype DFT problem we consider is A'' non- 
interacting spinless fermions confined to a Id box, < 
a; < 1, with hard walls. For continuous potentials v{x), 
we solve the Schrodinger equation numerically with the 
lowest N orbitals occupied, finding the KE and the elec- 
tronic density n(x), the sum of the squares of the occu- 
pied orbitals. Our aim is to construct an MLA for the 
KE T[n] that bypasses the need to solve the Schrodinger 
equation — a Id analog of orbital-free DFT (T^]. (In 
(3d) orbital-free DFT, the local approximation, as used 
in Thomas-Fermi theory, is typically accurate to within 
10%, and the addition of the leading gradient correction 
reduces the error to about 1% [l3|. Even this small an er- 
ror in the total KE is too large to give accurate chemical 
properties.) 

First, we specify a class of potentials from which we 
generate densities, which are then discretized on a uni- 
form grid of G points. We use a linear combination of 3 
Gaussian dips with difi'erent depths, widths, and centers: 

3 

v{x) = - ^ a. exp(-(x - 6,)V(2cD)- (1) 

i=l 

We generate 2000 such potentials, randomly sampling 
1 < a < 10, 0.4 < & < 0.6, and 0.03 < c < 0.1. For each 
Vj{x), we find, for up to 4 electrons, the KE Tj^jv and 
density rij^jv 6 R'"^ on the grid using Numerov's method 
[isj . For G ~ 500, the error in Tj^n due to discretization 
is less than 1.5 x 10~^. We take 1000 densities as a test 
set^ and choose M others for training. The variation in 
this dataset for TV = 1 is illustrated in Fig. [51 

Kernel ridge regression (KRR) is a non-linear version 
of regression with regularization to prevent overfitting 
[H]. For KRR, our MLA takes the form 

M 

T'^'^{n)=fJ2aMn,,n), (2) 

where aj are weights to be determined, rij are training 
densities and k is the kernel, which measures similarity 
between densities. Here T is the mean KE of the train- 
ing set, inserted for convenience. We choose a Gaussian 
kernel, common in ML: 

k{n,n') =cxp(-||n-n'f /(2cr2)), (3) 

where the hyperparameter a is called the length scale. 
The weights are found by minimizing the cost function 

M 

C(a)=^zli;2 + A||«f, (4) 
i=i 

where Z\T, = T]^^ - Tj and a = (ai, . . . , aA/). The 
second term is a regularizer that penalizes large weights 
to prevent overfitting. The hyperparameter A controls 
regularization strength. Minimizing C{a.) gives 

a^{K + \I)-^T, (5) 
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FIG. 2. (color online). The shaded region shows the extent of 
variation of n(x) within our dataset for N = 1. Exact (red) 
and a self-consistent (black, dashed) density for potential of 
Fig. El 

where K is the kernel matrix, with elements Kij = 
kirii^ rij), and / is the identity matrix. Then a and A are 
determined through 10-fold cross-validation: The train- 
ing set is partitioned into 10 bins of equal size. For each 
bin, the functional is trained on the remaining samples 
and a and A are optimized by minimizing the mean abso- 
lute error (MAE) on the bin. The partitioning is repeated 
up to 40 times and the hyperparameters are chosen as the 
median over all bins. 
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TABLE I. Parameters and errors (mean absolute, std. dev., 
and max abs. in kcal/mol) as a function of electron number A'' 
and number of training densities M. Brackets represent errors 
on self-consistent densities with m = 30 and £ = 5. The aj 
are on the order of 10^ and both positive and negative [TtI ]. 
^Training set includes Tij,jv, for j = 1, . . . , 100, A'^ = 1, . . . , 4. 

Table U gives the performance of T^^ (Eq. ^ trained 
on M A^-electron densities and evaluated on the corre- 
sponding test set. The mean KE of the test set for 
iV = 1 is 5.40 Hartree (3390 kcal/mol). To contrast, 
the LDA in Id is T'°'=[?i] = tt^ / dxn^{x)/6 and the von 
Wcizsacker functional is T^[n] = J dx n' {x)"^ / {9>n(x)) . 
For iV = 1, the MAE of r'°= on the test set is 217 
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kcal/mol and the modified gradient expansion approxi- 
mation [li, T^GEAj^] ^ T'°'=[n] - cr^[n], has a MAE 
of 160 kcal/mol, where c = 0.0543 has been chosen to 
minimize the error (the gradient correction is not as ben- 
eficial in Id as in 3d). For T^^, both the mean and 
maximum absolute errors improve as N or M increases 
(the system becomes more uniform as — > cx) Q). At 
M = 80, we have already achieved "chemical accuracy," 
i.e., a MAE below 1 kcal/mol. At M = 200, no error is 
above 1 kcal/mol. Simultaneously incorporating differ- 
ent N into the training set has little effect on the overall 
performance. 

With such unheard of accuracy, it is tempting to de- 
clare "mission accomplished," but this would be prema- 
ture. A KE functional that predicts only the energy is 
useless in practice, since orbital-frce DFT uses functional 
derivatives in self-consistent procedures to find the den- 
sity within a given approximation, via 



ST\' 



Sn{a 



(6) 



where /i is adjusted to produce the required particle num- 
ber. The (discretized) functional derivative of is 

M 

where a'j = (Xj j (cP' Ax). This oscillates wildly relative to 
the exact curve (Fig. [J), typical behavior that does not 
improve with increasing M . No finite interpolation can 
accurately reproduce all details of a functional derivative. 

We overcome this problem using principal component 
analysis (PC A). The space of all densities is contained 
in R*^, but only a few directions in this space are rele- 
vant. For a given density n, find the m training den- 
sities (rijj, . . . ,nj^) closest to n. Construct the covari- 
ance matrix of directions from n to each training density 
C = X^X/m, where X = [rij^ — n, . . . ,nj^ — n)^ . 
Diagonalizing C G BP^^ gives eigenvalues and eigen- 
vectors Xj which we list in decreasing order. The Xj 
with larger Xj are directions with substantial variation 
in the dataset. Those with Xj below a cutoff are irrel- 
evant In these extraneous dimensions, there is too 
little variation within the dataset, producing noise in the 
model functional derivative. By projecting onto the sub- 
space spanned by the relevant dimensions, we eliminate 
this noise. This projection is given by Pm,e{n) = V^V, 
where V = {xi, . . . , Xi)^ and £ is the number of relevant 
eigenvectors. In Fig[TJ with to = 30 and £ = 5, the pro- 
jected functional derivatives are in excellent agreement. 

The ultimate test for a density functional is to produce 
a self-consistent density that minimizes the total energy 
and check its error. This error will be several times larger 
than that of the functional evaluated on the exact density. 
For example, T^""^ on particles in Id flat boxes always 
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FIG. 3. (color online). Functional derivative of T^^"", evalu- 
ated on the density of Fig. [21 



gives 4 times larger error. To find a minimizing density, 
perform a gradient descent search restricted to the local 
PCA subspace: Starting from a guess n^^^ , take a small 
step in the opposite direction of the projected functional 
derivative of the total energy in each iteration j: 



0+1) =„0)_eP^^^(„0))(^+v„r^L(„o-))/^^)^ 



n 



where e is a small number and v is the discretized poten- 
tial. The search is unstable if £ is too large, inaccurate if 
£ is too small, and relatively insensitive to m 17 1. 

The performance of in finding self-consistent den- 
sities is given in Table ID Errors are an order of magnitude 
larger than that of on the exact densities. We do 
not find a unique density, but instead a set of similar den- 
sities depending on the initial guess (e.g. Fig. [2]). The 
density with lowest total energy does not have the small- 
est error. Although the search does not produce a unique 
minimum, it produces a range of similar but valid approx- 
imate densities, each with a small error. Even with an 
order of magnitude larger error, we still reach chemical 
accuracy, now on self-consistent densities. No existing 
KE approximation comes close to this performance. 

What are the limitations of this approach? ML is a 
balanced interpolation on known data, and should be 
unreliable for densities far from the training set. To 
demonstrate this, we generate a new dataset of 5000 
densities with N = 1 for an expanded parameter range: 
0.1 < a < 20, 0.2 < 6 < 0.8 and 0.01 < c < 0.3. The 
predictive variance (borrowed from Gaussian process re- 
gression [lit ) 

W[T^^{n)] = k{n, n) - k{n)'^ {K + XI)-^k{n), (9) 

where k{n) = (fc(ni, n), . . . , k{nM, n)), is a measure of 
the uncertainty in the prediction T^^{n) due to sparse- 
ness of training densities around n. In Fig. |4l we plot the 
error AT as a function of log{Y[T^^^{n)]), for both the 
test set and the new dataset, showing a clear correlation. 
From the inset, we expect our MLA to deliver chemical 
accuracy for log{Y[T^^{n)]) < -24. 
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FIG. 4. (color online). The correlation between MLA error 
and predictive variance for A'^ = 1, M = 100. Each point 
represents a density in the test set (blue) or new dataset (red) . 
The vertical line denotes the transition between interpolation 
and extrapolation. 



Docs ML allow for human intuition? In fact, the more 
prior knowledge we insert into the MLA, the higher the 
accuracy we can achieve. Writing T = + Tg, where 
Tg > [l3|, we repeat our calculations to find an MLA 
for Tg. For = 1 we get almost zero error, and a factor 
of 2-4 reduction of error otherwise. Thus, intuition about 



the functional can be built in to improve results. 

The primary interest in KS DFT is XC for molecules 
and solids. We have far less information about this than 
in the prototype studied here. For small molecules and 
simple solids, direct solutions of the Schrodinger equa- 
tion yield highly accurate values of E^c- Imagine a se- 
quence of models, beginning with atoms, diatomics, etc., 
in which such accurate results are used as training data 
for an MLA. Key issues are how accurate a functional 
can be attained with a finite number of data, and what 
fraction of the density space it is accurate for. 

A more immediate target is the non-interacting KE in 
KS DFT calculations. An accurate approximation would 
allow finding densities and energies without solving the 
KS equations, greatly increasing the speed of large cal- 
culations [l3|. The key differences with our prototype is 
the three-dimensional nature, the Coulomb singularities, 
and the variation with nuclear positions. For this prob- 
lem, finding self-consistent densities is crucial, and hence 
our focus here. But in the 3d case, every KS calcula- 
tion ever run, including every iteration in a self-consistent 
loop, generates training data — a density, KE, KS poten- 
tial and functional derivative. The space of systems, in- 
cluding both solids and molecules, is vast, but could be 
approached in small steps. 

Two last points: The first is that this type of em- 
piricism is qualitatively distinct from that present in the 
literature. The choices made are those customary in ML, 
and require no intuition about the physical nature of 



the problem. Second, the approximation is expressed in 
terms of about 10^ numbers, and only the projected func- 
tional derivative is accurate. We have no simple way of 
comparing such approximations to those presently pop- 
ular. For example, for A'^ = 1 in the prototype, the exact 
functional is . How is this related to our MLA, and 
how does our MLA account for this exact limit? 
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The purpose of this supplementary material is to pro- 
vide the information necessary to reproduce our ma- 
chine learning approximation (MLA) to the kinetic en- 
ergy functional exactly, as well as extra details about the 
nature of the MLA. Table Hill gives the first 100 potential 
parameters Oj, hi, and Ci to double precision. Along with 
the equations in the main paper and details of Numerov's 
method, one should be able to reproduce the correspond- 
ing weights ttj of the functional on line 4 of Table I in the 
main text. 



SELF-CONSISTENT DENSITIES 

Table U gives the percentage of variance lost, (1 — 
Ylij=i ^jl X]j=i ^j) ^ 100%, in taking the first I eigenval- 
ues in the principle component analysis (PCA) projec- 
tion. For each projection, there are G = 500 eigenvalues, 
but only a few are necessary to represent the local varia- 
tion in the densities. For example, with A'' = 1, to = 30 
and ^ = 5, we retain 99.98% of the variance when pro- 
jecting onto the PCA subspace. In Table HIl we coarsely 
optimize the parameters to and t in the PCA projection. 
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TABLE I. Percent of variance lost in taking the first I PCA 
eigenvalues with m — 30. Averaged over 100 PCA projections 
Pm,e{n) with randomly chosen centers n in the test set. 
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TABLE II. Mean absolute errors \AT\, in kcal/mol, on 100 
randomly chosen self-consistent densities in the test set, av- 
eraged over A'' = 1, 2, 3 and 4. This coarse optimization gives 
m — 30, £ = 5. Errors are less sensitive to m than £. For 
£ > 7, the gradient descent search fails to converge in some 
cases. 



Ax = 1/(G - 1): i', = ^{j/iG - 1)), V, = vU/iG - 1))) 
for j = 0, . . . , G — 1. Starting from i/jq — and tpi = 1, 
we calculate the remaining ipj iteratively: 



(2 - 5Ax^fj/6)^j - (1 + Z\x2/,-i)/12)^. 



'i-i 



1 



/12 



(2) 

where fj = 2(e — vj)). To determine the eigenvalues e^'^-' 
and eigenfunctions we find the first N intervals that 
contain a root of ipo-ii^), scanning from e = —3 
in steps of Ae = 1. For each interval k, we perform a 
binary search for the root, reducing the length of the 
interval to less than 10~^^. The eigenvalue is taken as 
the midpoint of the interval (the error in is less than 
5 X 10""'^^). After normalizing the eigenfunctions 
the density and kinetic energy are given by: 



NUMEROV'S METHOD 

We use Numerov's method [l[ to solve Schrodinger's 
equation for N non-interacting spinless fermions confined 
to Id box: 

1 \ 

-^-g^+v{x)Hix)=ei;ix), (1) 

with boundary conditions tp{0) ~ "0(1) = 0. We dis- 
cretize ipi^) ^-nd v{x) on a uniform grid with spacing 



N N G-1 

fc=l k=l j=l 



(3) 



[1] See e.g. E. Hairer, P. N0rsett, P. Syvert Paul and G. 
Wanner, Solving ordinary differential equations I: Nons- 
tiff problems (Springer, New York, 1993). 
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-21.84200888491582 
6.604738977945651 
15.27988423246628 

1.377130763885458 
-0.7756959351484244 
-9.50432792804336 

3.754137123031758 
-4.499804654067136 
-13.9999061688152 
-4.878405649764898 
-8.70611662690158 
3.578654662113496 
0.0423259541153967 
-6.387446031119123 
3.029693711282459 
-0.791031105864576 

2.97083681738158 
-7.110772604917624 
-7.162305080703513 
1.720368406482304 
0.1494884045649762 
-0.962821097034532 
0.935122045036145 
0.4328277236540677 
0.853043516035702 
-3.516191871248886 
19.67243760549639 
1.544060514744405 



1.180270056381577 

6.168993733519782 

9.08090433047071 

8.69723148795899 

1.880199805158718 

3.522977833467916 

5.286896436167961 

1.896112874949486 

7.516612508143043 

8.49309248159469 

7.105439309279282 

8.53955034289036 

7.853417776611835 

6.39698431139937 

4.228544205571447 

2.579686666551495 

1.107700596345898 

8.26435624701031 

8.74124547878586 

4.545173787725101 

1.015154584908506 

3.283098134816701 

2.056773486230531 

2.03703352205463 

6.400475835681034 

3.751807395744921 

4.522456026868127 

2.751346713386582 

5.725277193011525 

4.95871172966177 

6.451869235304859 

6.705508349541454 

7.390220519784453 

1.478170300165134 

4.045190240200832 

4.944179742822627 

2.988178201634472 

8.78996207364355 

6.242957525364009 

4.447521595114223 

6.919606258393273 

8.27200587323167 

6.220712308892191 

9.29716067662943 

3.424683176707511 

3.789578783769164 

1.195769022526768 

4.058614230578957 

5.159763617905121 

3.319181325761367 

4.005247740100538 

7.710615861039985 

4.728468083127391 

2.740626958875014 

3.209443235555092 

3.013659237176324 

2.088882156026381 

7.9733680986292 

5.105339790874075 

6.773414983805557 

6.41701161854283 

6.476325542442256 

1.300093759156537 

3.145607697855832 

3.121291975208031 

7.367027947839741 



9.43121814362608 

8.47929696159459 

4.708917711658332 

7.583635162152007 

3.414315967033806 

1.625552430388586 

3.42187897931262 

6.229538426957454 

9.15176346333775 

8.1525112801581 

4.670517118870347 

6.801389212739803 

4.406584351091798 

8.30408622139241 

7.975675712689654 

3.078380132262833 

4.294915349281119 

9.56936665353494 

5.052123646744015 

1.767169254935782 

8.38082427065573 

9.22706363472046 

3.106633667560681 

5.387619660361665 

6.780548897314363 

8.09818524171748 

7.260437643310942 

2.31788301454997 

4.113414259206836 

3.229317247568396 

9.20769534239692 

2.270663590855083 

4.017102041449901 



0.07195101071267996 

0.082993252991643 

0.07685302774688097 

0.06384871663070496 

0.03425540298495952 

0.07218055206599771 

0.04973324501652048 

0.03260897886438952 

0.0993184090181399 

0.0647507853307116 

0.0843184446680493 

0.07284904722467074 

0.07070077317679758 

0.05730660668578378 

0.06071899009977901 

0.0664318905447018 

0.05955381913217193 

0.04624196264776803 

0.0628793144768381 

0.03433189693421491 

0.07726595708511765 

0.06841617803957927 

0.0825699915945694 

0.07605517542793995 

0.03425589949139343 

0.0852624107335768 

0.03620201946841309 

0.0948195528516815 

0.03097303116261406 

0.06823254438777603 

0.05482804889270922 

0.0934749698077619 

0.07970661674181083 

0.03602109509210016 

0.03579955552582782 

0.0931916525333049 

0.07482186947515447 

0.04833452393773747 

0.0989568314234112 

0.06770523205457797 

0.0821756368975312 

0.0547013388431661 

0.04765956545437692 

0.0656810603414827 

0.0867529985575643 

0.07617326304382499 

0.04928749082970199 

0.04743875933294599 

0.0850570422587659 

0.05391080867981007 

0.07620861067494449 

0.07131617125307138 

0.06509200806253813 

0.06438323836566841 

0.05150806767094947 

0.0802684211883349 

0.07464091227469428 

0.0911843583955236 

0.06331718284342962 

0.07595819905259191 

0.06246944646172664 

0.07599435647188182 

0.06741885075599173 

0.0415292992761004 

0.03133561741752311 

0.07398108515426552 

0.0870950155799119 

0.03689894383172801 

0.05472141225455761 

0.0907364284065382 

0.0936829708421792 

0.05054048464274665 

0.04546236831654488 

0.0894449950697187 

0.0821521091215863 

0.04818682488618507 

0.0812975344211981 

0.04398267799553492 

0.07003309342623426 

0.0970211159011626 

0.0903948738093222 

0.0809649515974139 

0.06327626752293522 

0.0664706641817281 

0.06825963823641594 

0.05306973453715137 

0.0386273054889003 

0.0552127907704862 

0.06912140386549836 

0.04873990025387701 

0.04581500385875453 

0.0870012111933092 

0.0976595255928496 

0.05083396575279076 

0.05976249487823031 

0.07988404513340022 

0.04664288308967379 

0.07214599607965883 

0.0971170179967765 

0.04437090645089548 



0.5299345325943254 

0.5167227315230085 

0.5622686436063149 

0.5859464293596277 

0.4874044587130534 

0.4489170887611125 

0.4653609943491444 

0.4501033283280557 

0.5699793290550055 

0.4481376527388373 

0.4223871323591302 

0.5839058233689045 

0.5080787363762617 

0.5964415398755241 

0.4135235776817701 

0.4888525450630048 

0.5359207521608914 

0.4236237608297072 

0.4736196423196364 

0.4919021595234177 

0.4008988537732911 

0.4304195496937475 

0.479224783903814 

0.4501291515683585 

0.5544095818848655 

0.4453450848668749 

0.5050210060676815 

0.4901204212506473 

0.5511177785567803 

0.5645951313008806 

0.5694170176403242 

0.4420693171728495 

0.5081940602224835 

0.5799113381048154 

0.5678362348598895 

0.4834640277977335 

0.4950144569660614 

0.459203937360375 

0.4205662570527381 

0.5047965897298675 

0.5976799418614426 

0.4453254786423237 

0.4898959293071353 

0.4960066859011466 

0.4322548560407479 

0.5418490045761073 

0.5286859472378347 

0.4981149890354436 

0.5311491284465588 

0.5914435434600773 

0.5759225433332955 

0.4007362522722102 

0.4959400801351127 

0.5077158168564866 

0.5932432195310449 

0.5733460791404235 

0.4740072756248339 

0.5314007871406556 

0.5503804706506275 

0.5210834626114553 

0.4258923441426071 

0.4345528705798566 

0.4866345116967513 

0.5859414343226601 

0.524510056949801 

0.4753257600466925 

0.4807004710871501 

0.4801850915018365 

0.4949989702352598 

0.4550033334959929 

0.4110679099121856 

0.5043307410524706 

0.5426078576324179 

0.4941485628974172 

0.4118748449252315 

0.574408949666749 

0.5112853751964107 

0.4519472673718893 

0.5129214842481318 

0.4772975938521527 

0.5053209583744364 

0.5831990158889571 

0.4017988981679418 

0.5566289165852036 

0.5532353068476618 

0.4657297418468141 

0.4174202422881018 

0.5821800194923659 

0.5630023378185795 

0.5697049535893381 

0.5197835066282974 

0.5984908484842784 

0.4848535596042637 

0.54745303715986 

0.5809204376238206 

0.5262079910925557 

0.4916641780174803 

0.4111312070946356 

0.4613017967987272 

0.5073655615301741 



9.01320520984288 

8.30495143619142 

3.911674577648888 

8.67330877015531 

3.541514636747403 

3.332712157375289 

7.135152688153955 

5.885541925485173 

5.262683987610352 

3.62263291813646 

4.606936643431428 

1.340024891088614 

4.408481706562826 

5.472334579600375 

2.550224851908171 

3.764107410086705 

2.706093393731662 

7.025290029097274 

8.59166251408243 

1.726935494533148 

6.688534202733123 

5.887062834756559 

6.945590707033352 

1.45256356478288 

6.086484474478635 

7.559337237177321 

1.885091277540955 

7.863592227266858 

7.988513342309234 

9.08135225317634 

4.416924333519995 

2.858371131410651 

3.815123656821275 

2.105782960173057 

9.32386837735074 

9.3847979419491 

1.910770315838324 

9.93467757777873 

4.73983230004983 

3.987888630073714 

8.04099037018168 

7.433883810628654 

8.72249431241257 

6.796263459296078 

6.859255296971943 

1.363177133649232 

8.76714063033632 

1.015171237842736 

7.238990148015965 

9.11776045377491 

6.743529978394792 

3.372061685311945 

9.81266481664175 

1.813952930718781 

4.682408324655706 

7.441047648005995 



6.375772536276909 

9.5740821641842 

4.229974804881476 

1.379491105318868 

6.969363897694016 

6.942052331590217 

5.945295724435049 

8.03118879837252 

1.589160147317211 

8.85815411069566 

6.762463110315146 

4.776138672418544 

5.373320800648651 

6.09002215219153 

3.070996567281799 

4.091176923293506 

4.96749741331263 

2.377028497509498 

2.366656226877287 

4.530310672134927 

2.155276187476066 

9.92433910143913 

2.270764431848441 

2.454354187669313 

1.696376490191135 

2.138629261588504 

3.387516420897519 

7.233942984150266 

1.261670338009784 

9.99189882836594 

3.864226559651998 

2.929880196570098 

8.30700777463754 

8.22551991773337 

6.587571277412653 

2.153483785757176 

8.38162990306018 

8.19172407354263 

7.436994191324823 

9.19533615142581 

7.568725646832963 

8.22480560472966 

3.724036679477685 



0.092675711955144 

0.0890145060213322 

0.07551832009012722 

0.0876928787020957 

0.0983660639956121 

0.07852548530734836 

0.0956349249199585 

0.06240932269593134 

0.0972169632428748 

0.04018659271978259 

0.06326693058647106 

0.0781592051575039 

0.06298528328388489 

0.06570186368826426 

0.06424771468342688 

0.06576720199559433 

0.06561841006617781 

0.07980750197266955 

0.084738261964188 

0.03135796595505673 

0.0869544063742346 

0.05152399439496422 

0.07408636456892297 

0.07433692379389613 

0.07282844956128038 

0.05840909867970421 

0.06521780385848891 

0.0951797983951825 

0.0928323179868588 

0.04472856905840844 

0.04212208612720639 

0.03722557506068529 

0.04965529863397879 

0.0861928382367878 

0.0858648976559044 

0.0840810063497973 

0.03877152903045122 

0.0973964303071365 

0.0450110225161678 

0.03595136615254331 

0.03129262110881438 

0.04612202343826998 

0.05059967705235588 

0.04037116107097755 

0.0955962752949951 

0.03197249245240319 

0.0870852412295278 

0.085826684646538 

0.05867048711393652 

0.03583354001918901 

0.0967347280360008 

0.04579335436967417 

0.0951346706530719 

0.0845523320869031 

0.03641376226612134 

0.0924462539370359 

0.03993178348974601 

0.0933026364108379 

0.07463500644132846 

0.03532177545633547 

0.06306367927818108 

0.06669302037176108 

0.07107963920756023 

0.07414379406386953 

0.0987376029412809 

0.07398588942349949 

0.0936690521145114 

0.0977990134875495 

0.03835162624659654 

0.03739924536269347 

0.05895044789139901 

0.06968276328974509 

0.03836885039652842 

0.06031151123783582 

0.0963110933106458 

0.05059199769749539 

0.06652912486134806 

0.0489411436180854 

0.0931392820982872 

0.0853562757122116 

0.0857681690400504 

0.06783046119270637 

0.05374733302715019 

0.06654228293431248 

0.07736032999103362 

0.05392235260994765 

0.0347107535224807 

0.05464216708052787 

0.07966659968684009 

0.05249501630989304 

0.0831226693907787 

0.05694105237128053 

0.04734211110674212 

0.05791050943688269 

0.06806778195768599 

0.07641699196144898 

0.0944216012526871 

0.0806902033322297 

0.0536024772561282 

0.07622772645899346 



C2 

0.5396431787675333 
0.4169122081529295 
0.5086649497775319 
0.4850650257010839 
0.4515151404198366 
0.5852941028010116 
0.4408949440211174 
0.5618611754744713 
0.4726711603381638 
0.5253173968297499 
0.5381643193286885 
0.5383353695983426 
0.4611686076617371 
0.5473728709183074 
0.5203395167113864 
0.5481686020053234 
0.4269114966922994 
0.4683927184025036 
0.4564662508099403 
0.580800322296872 
0.403293222827825 
0.4321995606997443 
0.4957750456547108 
0.4233969076404344 
0.4272596897186396 
0.4990223467101435 
0.4961601035955842 
0.5196620049802691 
0.5146415116367569 
0.4299117124064201 
0.5897125000677342 
0.4216580500297413 
0.497023655525965 
0.4812528298377607 
0.5698752996855582 
0.4090254720704045 
0.5786659568499292 
0.4280349684453508 
0.559400017887981 
0.5929011044925536 
0.4686530881925831 
0.5269730370279639 
0.4421274052875277 
0.4389885737869158 
0.517620399931194 
0.5284999992906743 
0.5989638152903285 
0.5470349320774566 
0.5662410781222187 
0.4669413688494417 
0.4980631985926895 
0.4845503268496217 
0.5047212015277842 
0.407247659218711 
0.4491940043173043 
0.5216671466381739 
0.4402946238148492 
0.447244215655568 
0.5814481952546582 
0.5725615130215063 
0.4531443030507202 
0.517427894398595 
0.4930672781311588 
0.4548629476738681 
0.5128559599511593 
0.4644105814910987 
0.4120764594786555 
0.5880377299069773 
0.5785166211495689 
0.4468132406615605 
0.5451253692040614 
0.5702669702356848 
0.504879512949007 
0.4119028637456998 
0.4746736556808109 
0.4731074949729489 
0.5946245231853162 
0.5694756278652033 
0.4104016495146404 
0.4669596920988839 
0.576877467653029 
0.5788560723486603 
0.5432443229891937 
0.4304935498494862 
0.4274316541541941 
0.4355571344074666 
0.5316587974869709 
0.5051543239785165 
0.4992263633935188 
0.5669783762910612 
0.4274987667560087 
0.5226697825342788 
0.4077222220507315 
0.5794395625497382 
0.5479374417815378 
0.4316282085515486 
0.5792638413577232 
0.4952042950743076 
0.4745303011865644 
0.4368882837991222 



7.21030205171728 

8.80487613349391 

1.809709070880952 

4.189229162595343 

9.82668062409708 

8.14461268619626 

2.243825016881491 

6.486450948532671 

8.89032075863951 

1.155756643175955 

2.832289239384128 

7.396341414064901 

7.90542867326401 

4.715521015256764 

4.842862964307187 

1.399253719979948 

1.501048590877154 

2.822503099972245 

8.22877749776242 

2.502191185545461 

6.297133313147086 

3.207122477750064 

5.846222671659907 

8.95059302019488 

5.36207646433345 

4.729884445483556 

9.47421945496329 

9.51608680035275 

1.101098863639624 

8.24973637849809 

8.86521100790565 

6.670274811535954 

9.69945245311718 

7.010226383015251 

9.81895903799508 

3.673880603434117 

4.285706479098184 

4.931948094146255 

9.11978947943194 

5.22121823715344 

3.421695873368174 

8.3641619521824 

2.416276423317733 

2.206183147865627 

5.826144942819697 

4.9879001955338 

2.489565114307663 

6.343764732282688 

8.70600609334284 

6.117669336479262 

5.505849306951131 

8.6021995929235 

3.180268423645401 

1.054506345314588 

9.57800470422746 

8.15403131934562 

4.912298433960689 

7.387561983870292 

5.810342341443878 

8.88452823254966 

2.189456974183496 

3.961825639220393 

7.834870626014938 

1.062923665624632 

7.572783963151993 

1.719981611302808 

2.422694718173737 

8.48288777357423 

4.459069855546714 

1.831662246071428 

6.851478307492325 

5.360783854112533 

4.527748284314512 

4.581927607849956 

5.398545541594487 

4.34290365370739 

1.568860626254933 

1.947130206816878 

5.23036608102518 

4.42557413334857 

7.167289037979035 

5.118512758012828 

7.596013793576791 

8.43232828156106 



9.81884128475822 
4.794411329362948 
4.445064096761643 
6.920427033384797 
1.13457393933062 
6.828948529150043 
5.99005641944593 
7.143110762448606 
2.722302743095399 
9.93990336225375 
9.59671807016201 
6.980966479991427 
8.94919747461644 
3.970009703387312 
5.350822342112657 



0.0740833092851918 

0.0965994509648079 

0.095976684502697 

0.04518368077127609 

0.03264617089733192 

0.04848929881736392 

0.05865588304821763 

0.07293633775145438 

0.05632091198742537 

0.0910615024672208 

0.07970384658584057 

0.05945110164542845 

0.03887933278705098 

0.0803629674069167 

0.06333995603635176 

0.07540490302513119 

0.06352034496843162 

0.05222522416667061 

0.03727774324972055 

0.0856788809687475 

0.03345369328197418 

0.07371808389404321 

0.0836452454472081 

0.05703615620837187 

0.05780634160661002 

0.0929218712306724 

0.0556740133396159 

0.07785377315463609 

0.0882939028519791 

0.08854431361856 

0.0866581794842557 

0.0977332470946321 

0.07039341131023045 

0.03535327789989237 

0.04704020956533079 

0.07158934023489803 

0.05940487550770145 

0.0969410287755626 

0.06189826031162779 

0.04029431905467698 

0.05166215779587051 

0.07996879390804805 

0.07373660930828208 

0.0804910989081056 

0.0910408442631135 

0.04126125322920861 

0.05568685410478115 

0.0878769436185823 

0.04088387548046445 

0.04553014156422459 

0.0971440363586883 

0.0634681851083368 

0.06891913385037023 

0.0998274789144316 

0.089704223465467 

0.05611934350568269 

0.06528359492264517 

0.0977643384454912 

0.03327635127803191 

0.0932985710685446 

0.098078005933584 

0.0929115322244988 

0.06446115603870624 

0.07636214080338054 

0.0936192481138518 

0.04986976063479617 

0.05651923264880363 

0.05983735955021298 

0.06892772167363432 

0.05825558914206748 

0.04763840334231468 

0.0388888383066967 

0.05975894102927981 

0.0871948963692279 

0.0822574656780643 

0.07492904049493838 

0.04256882025605258 

0.06321309041201674 

0.0919529182014262 

0.0517800509473799 

0.0831206320171505 

0.06554617006512321 

0.0999924467044729 

0.06121769693920587 

0.03996347733060968 

0.0434164193614162 

0.04866392717198935 

0.03386907179361738 

0.03123407491202272 

0.07200760153994357 

0.05943349593138421 

0.07837921322316456 

0.04682210332386052 

0.083744615781603 

0.04266977230181523 

0.07198966517052108 

0.07647312161060935 

0.04263443777290076 

0.0982032349257953 

0.07659119397629786 



C3 

0.4120341150720884 

0.5711057094413816 

0.4024220371493795 

0.5819244871260409 

0.4352642564533179 

0.5484789894348707 

0.5687481170088626 

0.5695359084287562 

0.4056148051043074 

0.5870317055827734 

0.4171275695759011 

0.4924043842188951 

0.5872227397532248 

0.5354179520994888 

0.5244121975227667 

0.4655456988965731 

0.4331821043592771 

0.4810998521431096 

0.4697350798193826 

0.5909621331611888 

0.5433070470097552 

0.4967284534354185 

0.4094720200825416 

0.4679023659842935 

0.5503173198658324 

0.5590503374710945 

0.4834045749740091 

0.5806015592262945 

0.5265108634130272 

0.5416193648861009 

0.5311744230227635 

0.538756085129185 

0.4990744291774679 

0.4969989664577149 

0.5708692337579542 

0.5598196803643543 

0.4844513368813702 

0.4560660353529726 

0.493100819449519 

0.514129411681418 

0.4208560803818513 

0.5036755718396144 

0.5403850652535799 

0.5806221323132373 

0.4167014408128501 

0.4895167206754735 

0.5787056957942209 

0.5449452367497044 

0.5305143392409284 

0.4131324263527175 

0.45173467721102 

0.4207242810824543 

0.5758580789792047 

0.5956344420441539 

0.4702887735348434 

0.4910483719005932 

0.4923580906843156 

0.479824590293356 

0.5550216356360829 

0.5046388124857028 

0.5174384564079299 

0.4621043570336795 

0.5367219218216266 

0.4330291254331895 

0.4523240987335903 

0.5394709698394433 

0.4832351547748815 

0.4837560035001434 

0.5908529311844791 

0.566434199642786 

0.5010633160850224 

0.5784155467566237 

0.4670598506496871 

0.4176805754532423 

0.5258947233190487 

0.4038656375892337 

0.5491027801043556 

0.4122312147733568 

0.4465294974738288 

0.5645191809121128 

0.4221339680792799 

0.5571586558825978 

0.5115245622576321 

0.5527076848906498 

0.5091073130786462 

0.546118275633825 

0.5202815575942617 

0.4659081177469465 

0.4077156601519876 

0.444672072474744 

0.5115861497137036 

0.4668236040752577 

0.509084643832387 

0.5395428417251624 

0.5959901705863791 

0.4563024970288369 

0.5407763967437385 

0.5735261960865083 

0.5029128207513967 

0.4056243763991382 



TABLE III. All the necessary information to construct our 
MLA, trained from 100 densities with = 1 on a grid of 
500 points, with A = 12 x 10^^ and a = 43. For purposes 
of saving space, we do not list these densities. They may be 
reconstructed from these potentials via Numerov's method. 



